Navigating audio-visual Grainspace

نویسنده

  • Max Neupert
چکیده

Building upon the timbreID library for Pure Data, which is an audio feature analysis and classification tool with three-dimensional grading capabilities, I created an audio-visual instrument. Video frames can be cued to according to the auditory properties of the audio track by moving the hand inside a virtual cloud of snippets. This was achieved by combining three pre-existing things: 1. concatenative synthesis with a three-dimensional plot of the snippets 2. A Kinect sensor as an interface, and 3. Video playback along the audio.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Navigating the Hindrances Arising at Macro and Micro-level from Practicality of Transformative Pedagogy

The present study intends to probe the impediments for the practicality of Critical language pedagogy (CLP) in higher education system of Iran. To do this, 20 Iranian university instructors, holding Ph.D. degrees in TEFL, were asked to read a passage reflecting the main characteristics of transformative pedagogy. To explore the main obstacles, they were invited for a semi-structured interview. ...

متن کامل

Comparing the Impact of Audio-Visual Input Enhancement on Collocation Learning in Traditional and Mobile Learning Contexts

: This study investigated the impact of audio-visual input enhancement teaching techniques on improving English as Foreign Language (EFL) learnersˈ collocation learning as well as their accuracy concerning collocation use in narrative writing. In addition, it compared the impact and efficiency of audio-visual input enhancement in two learning contexts, namely traditional and mo...

متن کامل

VisPod: A Visual Audio Player for Content Exploration

Current audio player interfaces generally provide brief information such as title and duration time and support basic control functions including play, pause, rewind, and forward. These features alone are not sufficient for certain user tasks, such as quickly finding a previously-visited location or browsing the main topics covered before listening. We present VisPod, a novel visual audio playe...

متن کامل

Effect of Information Modality on Geographic Cognition in Car Navigation Systems

Much research has focused on exploring the safest ways to present navigational information in vehicles. However, these efforts often neglect to focus on other measures of driver performance that may affect user satisfaction. Drivers may wish to gain an understanding of a geographic area in addition to simply navigating to a specific location. In this article, we complete an empirical study with...

متن کامل

Biologically Motivated Audio-Visual Cue Integration for Object Categorization

Auditory and visual cues are important sensor inputs for biological and artificial systems. They provide crucial information for navigating environments, recognizing categories, animals and people. How to combine effectively these two sensory channels is still an open issue. As a step towards this goal, this paper presents a comparison between three different multi-modal integration strategies,...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2012